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The ultimate, moat holy form of theory is action^ 

Nikos Ka25antzakis. 
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ASSTHACT: 




This paper presents a rapid scaniidn^ of the state of the 
art &f research and evaluation of\outward Bound and ~ 
related educational programs. IniVtial comments outline 
criteria for assessing internal and external validity 
of studies* Distinctions are made \between research, 
evaluation, measurement, judgement ,\ and publio relations. 
The work of Rosen.^ Hutchinson, Scri^en, and Stake is 
recoimnended as important background reading for those 
interested in the evaluation of Experiential Education 
prograuns* Summary of existing work i\s presented in five 
categories: (,1) Studies of Outward Bound programs, (2) 
Studies of related educational programs, (3) Studies of 
programs for urban youth and delinquen\ts, (4) Non-empirical 
studies, (5)- Recent work. 



INTRODUCTION: 



Internal 
validity. 



Sometimes it seems that admitting an interest in 
research and evaluation is akin xo an acknowledgement 
of leprosy in .some Outward Bound Wircles. However, 
it seems that if Outward Bound meWod^ are to. 
become accepted as part of formaj^ ^i^ducation then a 
responsibility Vexists to demonstrate (prove?) to 
others that programs are meeting tneir .stated goals. 
A secondary interest is that of upgrading; the quality 
and consistenc y : of programs for "ij^-house" improvement. 



Studies of Outward Bound, or relate^ educational 
programs, can be. divided into two main categories: 
(1) Experimental; (empirical) , and Non-experimental 
studies*. The intention. of experimental studies is 
to demonstrate the ^existence (or non+existence) of 
a causal relationship between the Outward Bound 
program and observed, ^changes in participants, such 
as "enhanced self-concept.** \ 

Problems associated with demonstrating a causal 
relationship between program and. change partic- 
ipants can be examined by use of a; setl of criteria 
entitled "threats to internal validityl" These help 
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us decide if the changes we obsei've in people are 
^ caused by the experience or by some other factor. 
Threats to Common threats to internal Validity are^^ 

internal Maturation . Perhaps the changes we observe 

Validity. simply due to the fact that the individuals 

concerned have.grovm older. (Usually .guarded 
against by the use of a control group.) 

2o Testing . Perhaps the form of testing we are 
using is such that changes in responses at the 
end of the experience are really the result of 
the student "second guessing" the test based 
on having taken it once already prior to the 
experience. 

3. Selection of Individuals . If a control group 
is used to guard against maturation effects, it 
is important that the control group and the 
group participating in the program be*" similair. 
(Usually achieved by random assignment of 
individuals to groups.) 

The point here is not to give a detailed treatise on 
experimental research design, but to indicate some 
of the factors involved if one is going to make a 
serious attempt at demonstrating a causal relationship 
between program and changes in people that will 
satisfy knowledgable educational sceptics^ The three 
above mentioned threats to internal validity are from 
a list of seven criteria frequently used for \ 
evaluating the quality of educational research. 

A second important consideration in experimental 
research design is, "O.K., it seems that the experience 
has caused some changes in this particular gi^oup. But, 
'Generalising to what extent can we generalise from this group to. 

to other others?" In the, above example of enhanced self-concept 

groups. we need to know how likely it is that other groups, 

at other points in time, will manifest similair 
self-concept changes as a result of similair experiences 
The degree to which the. results of the study can be 



^ 'The examples of sources of internal experimental 
invalidity used here are based on D.T.Campbell and 
J.C.Stanley's " Experimental and Quasi-Experimental 
Designs for Research ," Hand McNally & Co. 1972. 
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Ercternal generaVised'^s called the external validity of the 

validity^ study. There are a number of threats to external 

validity that need attention if we are . interested 

in generalising our results: 

!• Group studied . Perhaps the group studied is 
not representitive of a voider population of 
people. 

2* Interaction of T'^rsonal Characteri>stics with 
the Experience . Perhaps the experience will 
cause changes in a group of white middle-class 
students, but not. do much for inner-city 
students of ethnic minority backgrounds. 

3» Hawthorne effect . Perhaps students behave 

differently if they know they are participating 
in a study; Othjer groups in the future not 
involved in a study might have different responses. 

4# Novelty- effects ^ Perhaps it is simply the fact 
that students are in a new situation that makes 
for changes, irresj^ective -^f^ program design. 

These, are only three of a listing a eleven possible 
threats to external validity used in evaluating 
educational research. (l) 

Well, -enough of this. The point here is simply that 
to carry out experimental research 'which both , , 
demonstrates a causal relationship between program 
and observed changes in n^^ople, and which can be 
generalised t^ other peop. and other situations, is 
complex and time consuming- Respectable research 
designs must pay attention to all known threats to 
internal and external validity if they are xo carry 
much weight* 



/ 

/ 



The complexity of experimental research necessitates 
a' good deal of "tinkering" by the researcher, and it 
is; difficult to obtain the desired degree of control 
in a program such as Outward Eound» 

Consequent^^y many of the studies focuss.ing on 
Outward Bound or related educational programs are 
not true experimental designs, and frequently fail 



^ ^From, -^' The JSxternal Validity of Experiments /^ 
Bracht, Glenn H. , and :Glass, Gene V., Laboratory 
of Educational Research, University of Colorado. 
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to meet known criteria for internal and external 
-•validity* In a recent work whicii reviewed the 
substantial amount of research literature available 
on Outward Bound, Smith (l973) concluded that "to 
date •••• no evaluation study has been conducted 
to demonstrate unequivocally the results of Outward 
Boimd* (l) Smith qualifies this statement by adding, 
"that studies did not meet the criteria of unequiv- 
ocal results is not an indictment of the studies 
reviewed, since many different roles may be played 
by evaluation studies* Rather they lay^a premise 
for-iHore controlled^ experimentation if the intent 
of Outward Bound is to demonstrate conclusively the 
effects of the program." 



For myself ,n as I look at the existing literature, it 
\ seems that a good deal of it ^falls into that class 

Have test, of research wh-ich one might disparagingly call, "Hfe^ve 

will travel] test, will travel," or, "An instrument looking for 

a phenomenon to happen." Namely, that insiif f icient 
care has been tEken in the design of the study in 
identifying variables of interest, and in developing 
an appropriate methodology. 

Smith mentions that although the studies which have 
been reviewed often fail to meet rigorous criteria 
the results can still be of interest and of use. 
Some distinctions might help here. Rosen states, 
"although they are inextricably linked in the 
Research and minds of many educators, research and evaluation 

evaluation. ' are "generally not mutually enhancing endeavours, and 

ought ±€k be undertaken seperately." (2) Rosen 

makes distinctions between research, evaluation, 
measurement, judgement, and public relations* 

Research . ''Generating knowledge for the sake of 
knowledge." 

2. Evaluation . "Improving educational enterprises 

by providing data for enlightened decision making." 

3. Measurement . "Testing using valid and reliable 
instruments .w'....o Some evaluators insist that 
evaluation equaJLs measurement. Where no instruments 
are yet available to measure important goals, and 



Smith, Mary L., Gabriel, R. , Anderson , Ronald D., 
Pinal Report; Project to Desi^ aa Evaluation of 
Outward Botmd . Bureau of Educational Field Services, 
University of Colorado, 1973f P»l« 

Rosen, David. " New Evaluation for New Schools^ " in. 
Changing Schools, Educational Alternatives Project, 
Indiana University, School of Educ* Room 326, 
Bloomington, Indiana, 47401 • 
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v/here available instruments do not measure what 
decision makers are most concei*ned about, this 
practice is absurd*** 

Judgemejrt. ( Outside expert model ) > "because 
Judgem,ent evaluation does not systematically 
collect decision makers goals ••••data are 
likely to be irrelevent. 

Public Relations * "For improving the program 
image Provide data on goals which are 

judged in advance as most likely to succeed. 

Rosen includes in his article a description of the 
recently developed Portime/Hutchinson Evaluation 
Methodology, (l) I recommend that anyone interested 
in the evaluation of ICxperiential Educations programs 
who is feeling a lixtle bit overwhelmed by all this 
talk of internal and external validity, look at this 
material, toge'ther with Rosen's article. Two other 
important recent publications which will help give 
orientation before proceeding with a research or 
evaluation effort are: v _ 

1. The Methodology of Evaluation , by Michael ^ 
Scriven.Jfi, Ed(v;c<yt"tdV^^ f E^ft(«/<^lTofia ^ U)onne>^ 

2, The Coxmtenance of Edxacational Evaluatien^ 

by Robert Stake. In, "Teacher's College Recoird," 
Vol. 68, NOo7t April I967. 

Scriven and Stake are two leading names in recent 
developments in evaluation which give hope to the 
possibility of developing meaningful approaches 
which are relevent and appropriate for Experiential 
Education programs* Whether you are interested in 
designing your own research or evaluation, obtaining 
the services of an. "expert" to do it for you, or 
simply in getting a handle on the current jargon t© 
help make sense or the reams of material available, a 
little time spent with the ideas of Rosen, Hutchinson, 
Scriven and Stake, will pay real dividends. 



W it h eB e~- th o ugh t s in- ra ind" ! ' ^ ill" 1 aun c h" in t o' a 
rapid overview of existing research and evaluation 
on Outward Bound and related educational programs* I 
will make no -attempt' to evaluate these studies using 
criteria of internal and external validity, but will 



(1) 



Major parts of the methodology are available in 
mimeographed form from. Dr. Thomas Hutchinson, 
Center for Educational Research, School of 
Education, University of' Massachusetts, Arr^erst, 
Mass. 01002. 

9 
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simply remind you that the data from any study 
quoted here needs to be approached with caution# 
^ In some cases the changes reported mi^ht hot be^ 

the results of the program, and. I'esuJ.ts do not 
^ necessarily generalise ta other groups and other 

situations. You will- need to look at' individual 
studies yourself and 'make up your own mind on 
their validity* 

The available literature can be classified int© 
five categories: 

\ ' 1. Studie^ of Outward Bound programs* 

\ ■ ^» Studies of educational programs related to 

\ Outward Bound. 



3» Studies on prograjns for Urban Youth and 
Le.linquents* 

4» Non-Empirical Studies^ 

5* Recent v/ork# 



STUDIES. OF OlPfWARD BOUKD PROGRAMS; 



Strengthening 
self-iraage. 



Social 

functioning. 



An early study by Richards (I966) used a Semantic 
Differential Test with a group of 90 boys enrolled 
in Colorado Outward Bound School 'course C. 11. Richards 
concluded that there had been a "substantial strength- 
ening of the self-images of the great majority of the 
young men who went through the course.'' . Using interview 
techniques with a smaller sample^ Richards concludedL^ 
that (1) "boys with stronger self-images and more 
outgoing personalities will enroll and participate 
in Outward Bound more than boys whose self-confidence 
is not. 80 strongj^" (2) "The results of the program 
appear to be felt more in areas of social functioning 
than in academic pursuits." 



more 
stable 



A - studx" carried oat' in" Engtaixd, Strut t ( 1 966")" Wing 
the Sixteen Personality Factor Questionnaire, the 
Intelligence Progessive Matrices Test^ Self^-ratingSy 
sponsor ratings, and confidential Outward; Bound 
student reports, concluded that in coriparison with: . 
a control group, giTl s who had completed an .Outward 
Bound course were relatively more stable, more « 
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iependable y 
ri tical* 



Change in 
self-concept. 



Self-imcige , 



Control 
personal 
fate • 



Changes in 
personality and 
values. 



Tolerance of 
■ other sv 



dependable, moro critical, livlier, less sensitive, 
and less con-ventional* 

L/ 

Clifford^ and Clifford (196?) examined the effects of 
a Colorado Outv/ard Bound School coiu?se on adolescent 
boys. They concluded that '^overall change in the 
seif--concept did take place in the appropriate 
direction and discrepencies' between the self and 
the ideal-self were reduced." 

An evaluate on^ of the Outward Bound^^Teacher *s Practicum, 
Hawkes et al. (1969) using a^ questionnaire and 
interviews some time after the program had ended 
concluded that "the Outward Bound' Teacher Practicum . 
...p.. is ^ experience which^ influenced or changed 
m'ony teacher 's\self-image and view of their profession. 

In a study carried out at the North'^'Caroline Outward 
Bound School, Borstelpann (^1969)? one of the main • 
conclusions was that,/ "associated with the"^ program 
experience is a general increase among studeijts in 
the belief that they can control their personal fates." 
Borst,elmann aiso concludes that 9 "student ^Value 
hieraTchies . show some tendancy to ' move towards 
staff positions about the impor^tance of. competent 
behaviours And^ in a cautionary note, he points 
out that -Outward BoUnd, "^does a better job with those 
students who arrive sharing convictioTis about self— 
determination and getting on with the '."job in a 
cooperative, task-centered taonner." / 

Shulze (^1970) , using a combination of questionnaire 
and personal interview, concluded, that . the Outward 
Bomid course , " is an intense personal experience 
frequently involving changes in personal-ity and 
values,"' and, "enables" (participants) to. look 
differently at themselves and the world. He also 
concluded that "one of the most significiant results 
of the Outward Bound' course "appears to be an 
appreciation »and tolerance of others different from_^_ 
•"o^r^esel"f ' " ' " '~\ 



Positive 
self-concept r 



In a study of 78 Toledo high school students^ which 
used the goals of a high school guidance program as 
a frame of reference, Lovett (l97l) concluded that 
students who participated in Outward Bound gained a 
more positive self-concept, became more confident 
in decision-making, and enjoyed better interaction 
with their peers. Lovett also concluded that high 
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school giiidaiice counsellors working in a program 
Ro"'es of that promotes the concepts of% Outward Bound were 

counsellors more likely to fulfill their true counselling roles 

and to foster within students the concepts which the 
counselling profession desires to promote, 

Fletcher (1971) carried out a questionnaire study of 
3,000 students who had taken Outward Bound courses 
in EInglando His main conclusions were that both - 
r>t\idehts and their sponsors felt changes had occured 
Self-confidence, in (l)increase(i self-confidence. (2) greater'^miitu^rfy , 



Needs of 
. others* 
iV.aturity. 

Permanence 

changes*...-- - 



of 



C3) greater awareness of ■ thre needs_^,pf--oth'e'rs , aiid, 
(4)--greajter-^aM'lity to mix welL^< 'Fletcher also 

Lilted that the majority^of sponsors and students 
felt thatf "the.- influence of a single Outward Bound 
course is very perSistenii , with .the majority of 
sponsors and students expressing the= feeling that 
changes are permanent • 



Positive 
change in 
Self-concept a 



A study by Whetm^re (1972) looked at the effects of 
,. Outward Bound on the self-concepts of 219 boys who 
attended the Hurricane Island Outward Bourid , School • 
Wetmore used the Tenjiessee oelf-Concept Spale,'the 
Kelly and Baer Behaviour Rating Scale, and self-reports 
from students six months after the course^ He concluded 
that there was "a distinct positive change in self- 
concept while in attendance at the Outward Bound 
School," that, **the iixtensity of positive change in 
self-concept decreased after they returned to their 
Changes decrease home environment," and that »'self-conpept changes - 
in home v/ere consistent with behaviour" as refleoteli by the 

environment. instrixctor ratings on the Kelly and Baer Behaviour 

Rating Scale^ Wetmore did not use a control group 
and his sample of 219 students included low numbers 
I ^ of students in certain- background categories, i«e« 

race and socioeconomic status. 

; Davis (1972) looked specifically at the experience 

\ of fear during the ^ock climbing phase of an Outward 

\ - 3ound program*^ -A- mailed ' ques-tionnai-re-i;o-Ouirward 

Bound graduates surveyed, reactions before, during^ 
and after rock climbing, Plot-^ing his data on 
graphs, Davis concluded that "the overcoming of 
Self-awaraness# fear results in new levels of self -awareness and 
Self-confidence, self confidence • He addad that "the transformation 
of fear into enthusiasm must be considered as a 
prime value in the increased self— awa^ness and\self— 
actualization resulting from rock climbing.'* 
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Roles of 
counsellors. 



school guidaiice counsellors working in a program 
that promotes the concepts of% Outward Bound were 
more likely to fulfill their true counselling roles 
and to foster within students the concepts which the 
counsellinip: profession desires to promote. 



Fletcher (1971) carried out a questionnaire study of 
3,000 students who had taken Outward Bound courses 
in EInglando His main conclusions were that both - 
r>tiidehts and their sponsors felt changes had occured 
i^elf-conf idence. in (l)increase(i self-confidence. (2) greater'^niiitu^rfy , 



Needs of 
others^ 
iV.aturity. 

Permanence of 

changes*.--- - 



C3) greater awareness of • thre needs_^,pfi-oth'e'rs , aiid, 
(4)--greajter--ab'Vlity to mix welL*< 'Fletcher also 

rxiided that the majority^of sponsors and students 
felt thatf "the.- influence of a single Outward Bound 
course is very perSiBtenii , with the majority of 
sponsors and students expressing the= feeling that 
changes are permanent • 



A study by Whetm^re (1972) looked at the effects of 
^,Outward Bound on the self-concepts of 219 boys who 
attended the Hur3^icane Island Outward Bourid , School • 
Wetmore used the Tennessee oelf-Concept Spale,'the 
Kelly and Baer Behaviour Rating Scale, and self-reports 
from students six months after the course^ He concluded 
that there was "a distinct positive change in self- 
concept while in attendance at the Outward Bound 
* School," that J "the iixtensity of positive change in 
seif-concept decreased after they returned to their 
Changes decrease home environment," and that »'self-conpept changes - 
in home v/ere consistent with behaviour" as reflecteli by the 

environment, instrixctor ratings on the Kelly and Baer Behaviour 

Rating Scale^ Wetmore did not use a control group 
and his sample of 219 students included low numbers 
I ^ of students in certain background categories, i#e# 



Positive 
change in 
Self-concept 



race and socioeconomic status. 



:ielf-awaraness# 
Self-confidence. 



Davis (1972) looked specifically at the experience 
of fear during the ^ock climbing phase of an Outward 

3ound program*^ -A- mailed - quest ionnaire—to-Outward 

Bound graduates surveyed, reactions before, during^ 
and after rock climbing^ Plot-^ing his data on 
graphs, Davis concluded that ''the overcoming of 
fear results in new levels of self— awareness and 
self confidence He addad that "the transformation 
of fear into enthusiasm must be considered as a 
prime value in the increased self— awa^^n ess and\self— 
actualisjation resulting from rock climbing.'* 
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More positive 
view* 



In a recent study Koepke (1973) examined the effects 
of a Colorado Outward Bound School course' on the 
anxiety levels and self-concepts of 33 male and 11 
... female participants. Koepke used the Gough Adjective 
" Check list as a self-concept measure and the State- 
Trait Anxiety Inventory as an anxiety measure. She 
conclude'd that . Outward Bound participants **view 
themselves more positively and possess lower anxiety 
levels at the' end of a course." 



STUDIES OP EDUCATIONAL PROGRAMS RELATED TO OUTWARD BOUND: 



A study by Naches and Roberts (I967) examined the 
effect of Outward Boiind adaptive programming on hi^h 
school students of Adams County School District No. 
14 in Colorado, in vol v|ed in a program entitled, "Dare 
to Carep*^ The authQfrsi of the study were professional 
psychblogists on the school district staff . Using the 
High School Personality Questionnaire, a Student „ 
Attitude Survey, and a Staff Rating Scale, with three 
groups of students, "top students, volunteers, and 
potential drop-outs," they- concluded that all students 
became more (l) outgoing,, (2) affected by feelings, 
(3) assertive^ (4) tender-minded, (5) self-controlled. 
Self-ccntrolled, They also concluded that these changes wex»e most 

significant for .the students categorized as "potential 
drop-outs." >>. • 



Outgoing* 
Assertive* 



Drop-outs« 



•Catalyst. 



A study by Shulze' (19^71) . entitled the Impact of. 
Outward Bound on Twelve High Schools , used a.. combination 
of observations of schools, reading of existing 
reports, and questionnaires sent to ajl schools. His 
conclusions included that Outward Bound programming in, 
the schools studied has served as a "catalyst" challeng- 
ing commonly held notions regarding "scheduling, 
curriculum requirements, student-teacher relations, 
strictly cognitive curricula, and performance criteria." 
Schulze reports that Outward Bound has "legitimiased and 
provided sanction for the progQ?essive notion of learning 
by doings *l and that programs in the schools he studied 
have provided "a vehicle for curriculum reform." In the 
area of human relationships Shulze reports that Outward 
Bound^ served to "bring opposing groups together and. r 
initiate dialogue and interaction." Little formal 
methodology was used in this study. Shulze relied 
mainly on his own interviews and observations. 
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Person and Smith (] re formal look 

at an Outward Bom r^ram (Project 

Adventure) at Ham .\h ..^.^^ional High School 

in Massachusetts. attery of different 

tegts (Rotter Scale of Internal and External Control, 
Teiuiessee Self-Concept Scale, Litudent Questionnaire, 
oelf-Rating Scale, school Climate Survey, and physical 
tests) the authors' major findings were .(l) that there 
Positive change, was "overall positive change for the sophmore class," 

(2) that students involved in the project showed a 
Internal control. higher degree of internal control, . (3)* that students 
Regular school exhibited a "significant decrease in general enthusiasm" 
program. for the regular school program, and, (4) in general, 

Girls did as "girls did as well, in many instances better, than boys." 

well as boys. , 

Looking at Outward Bound as a strategy for organizationar 
change in a large public school district Godfrey (-1972) 
concluded that (l) project participants experienced 
significant personal growth and improved iriter-personal 
. relationships, (2) the Outward Bound project stimulated 
Organizational organizational change in the district by involving a 
ch-axige. wide range of senior administrative personnel in addition 

^.o teachers and pupils, (.3) the Outward Bound project 
"influenced teachers in their work with both colleagues' 
and pupils, "^ (4) "the initial positive response of 
fiiiduring , participants *..*•« exhibited an enduring quality*" 

quality. - (Maintained six months after the experience as measured 

by a mailed questionnaire.) 

An evaluation of an Alternate Semester program at 
Lincoln Sudbury Regional High School in Massachusetts 
was carried out by three staff members of the program^ 
Copp, Pierson, and Sargent (1972). Their report 
includes student anecdotal responses, the results of 
^ a questionnaire sent to parents, staff evaluations 

of particular units, and overall staff 'evaluations 
of the project. Among their major findings is the 
statemeait, " if there is one consistent theme that 
runs throughout the evaluations it is that the majority 
Porsitive , of these students acquired a moire ' positive , self ^ 

self-confident • confident image of themselves. The authors al'so make' 
the summary conclusion that "there is no question that 
the^Se students were deeply affected and most left 
Courage to face this program with more courage to face themselves 
self and and the world." ' 

vjorld* 

Ratliff (1972) carried out an evaluation of the 
Senior Seminar program at Denver East High School in 
Colorado. A questionnaire was completed. by 93 
students involved in the seminar and by a control 
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Future goals. 
Personal 
change. 
Parent 

relationships^ 

College 
ambition* 



group consisting of 3I seniors randomly selected 
from the student body of the school* Summary of 
much of the data is not Tnclude^"^ in the report. An 
item-by-item listing. of uoud ijonses to the 

59 questions included in the qui: . cionnaire is given* 
Ir. comparison with the cont r'o ,i.*oup Rati iff reports 
that aeminar-istudents (l) developed more meaningful 
relationships With teachers, (2) felt that the Seminar 
experience had had a significant effect on their goals 
for the future, (3) viewea the Seminar as an experience 
leading to personal change, (4) related better tp/;.., 
thisir parents, (5) related better to members of other 
racial groups , (6) developed closer personal relation- 
ships with other students, (7) increased in their 
desire to go to college. A questionnaire given to 
parents recieved positive responses to the cost of 
the seminar and to the difference it had made in their 
c}iildren*s lives. 



Following on^ from Ratliff 's 1 
Public Schools carried out th 
of the East High School Senio 
The Seminar was criticissed f^6' 
but^'i-n the conclusion of the 
Self-understand- identified improved self-unde 
ing. relations with students ^from 

Race-relations. improved understanding of soc 
Value of of the value of (education , as 

education* the Seminar, 



972 study, the Denver 
eir own evaluation 
r; Seminar, Elledge (1973). 
S>a.lack of precise goals, 
study the^ e^yaluators 
r standing, improved 
other racial groups, 
iety, and improved sense 
th e ma j o r but comes of 



Positive 
growth in 
self-concept.. 



A semester— long.prgram at a Colorado Springs high 
school, modelled on the program at Denver East High 
School, called the Mitchell High School Senior Seminar, 
was evaluated by one of its staff members, Fornander 
(1974) • >Using a variety of evaluation methods including 
student reactions, staff evaluations, evaluation by. 
observers, and a statistical pre-post test employing^ 
a randomly selected control group# A flaw in the ^ ^ 
statistical design (namely that students did not 
write their names on the test instruments) prevented 
formal statistical analysis of the data. Three 
instruments were used; the Tennessee Self-Concept 
Scale, the School Climate Survey, and the Student 
Description Form. Respoi^ses on ten of the twelve 
scales of the Tennessee Self-Concept Scale showed 
'•desirable changes (indicating positive growth in 
self-concept) for the Seminar students. In most cases 
the mean differences (group data) fox» the Seminar 
students was noticeably greater than for the control 
group." The results of the School Climat.e survey 
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Less positive 
about regular 
school. 

Teacher 
warmth. 



Consideration 
of others. 



Positive 
self— c oncept • 

Strengths and 
weaknesses. 
Responsible for 
own actions. 



Accept others 
\as they are. 



UDIES OF UtlBM YOUTH MD DiiJLINQUENTS : 




indicate that Seminar students felt less positive 
about the regular school program than the control 
group, both before and after the Seminar. A 
significant change for Seminar students was an 
increased fo^O ing of teacher warmth ..towards them. 
The contr oup did not change in its perception 

of/tea^ There was little difference 

betweei oni: ^students and control group on the 
Student ,.'uion Form, with the exception that 

the Seminar students showed an incriease on the 
di|mension/ "Consideration of Others." 

A ^semestei>-long program',' the Wasson Experiential" 
Education Seminar, at another Colorado Springs 
High School" was evaluated by two teachers at the 
school, Morris and Hart (1974) • Their report 
incorporates two complementary approaches, (l) a 
detailed statement of goals generated in part from 
overall educational goals of the school district , 
leading to reactions from students, staff, and 
parents, and, (2) a pre-post testing of Seminar 
students using the W.E.E.S. Affective Inventory, 
(Modified from "Inventory of Outward Bound Effects," 
Smi^h et al.. Bureau of Educational Field Services, 
University of Colorado, 1973.) The data from the 
Affectivie inventory indicate; (l) *^'a more positive 
self^-concept has , apparently 'cieveloped during the 
Deriod of the Seminar, (2) on the dimension measuring 
self-^awareness the report states that "many students 
are m'pre cognizant of their strengths , and weaknesses^" 
(3) on the dimension measuring self-assertion the 
authors state that "students now feel they are^ more 
responsible for their own actions* " (4) little 
change is reported on the dimension wes^suring accept- 
ance of others, but the evaluators state that "one 
area of si>«:nif icant progress during the Seminar has 
been the tendancy of most, studer vs to accept othe:r's 
for what they are." 



Active., 
less aAienated. 



*^ork in this area was begiui by Schroeder and Lee 
(1967) with a study of 40 inner-city, low-achieving, 
high school students. After Outward Bound the group 
was found to perceive themselves individually as more 
active, stronger, more positive, and less alienated. 
With regard to others the group demonstrated a greater 
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Tndividualsw capacity to see other people as individuals, and > a 

greater capacity to <vieW peers and teachers as more 
positive and helpful. The group also showed a more 

Goal-orientation, mature goal-orientatidn and greater flexibility of 

Goal-achievemen b.meajLs of goal-achievement* 

^" ociQV (1968) carried ou a Iwo-year study 

'icated delinquents fr a the Massachusetts 
- ituh rvice- wiio participated in Outward Bound • Of 
\ * - .4^ boys who completed the program, the recidi.yisra rate 
Recidivism ^ ..)was 20^ compareid* to figures of 40% for./the State of 
rate, • : Massachusetts and. 50% - 60% for the Nation, The work 

• carried but in tliis study received considerable > ; 

attention and was '"published, in two prof essional- y ~ 

journals, Kelly and Baer (1969) and Kelly and Baler i 
(1971). i 



Cohseqiienc'es of 
aggression^ 



Freeman, Spilka, and Mason (l969)> carried out an 
empirical evaluation of adjudicated delinquents who/ 
participated in a cooperative program with the 
Colorado Outward Bound School. The evaluators main 
hypothesis, that Vthe consequences of aggression would 
come to be negatively viewed,''^ was accepted* 



NON-EMglRICAL STUDIES OF OUTWARD BOIMD ; / ■ . 

Lev (1968) makes a comparison between the American 
Indian world view and the Outward Bound concept. He 
points^ out that ''the Americaii Indian has .h?id a view 

of reality, or world view, which was rooted in 

a response to the coercion of nattire," He follows 
this by stating that^ "the philosophy behind programs 
such as Outward Bound is oriented toward ,««•«,, a 
confrontation with nature," Lev suggests that ''perhaps 
a working relationship can be established between the 
red man and the, white man with this goal and path in 
mind," 

In a comparitive study which examined the Hurricane 
Island (U,S«A«) , Moray (Gt, Britain), and Eskdale 
(Gt, Britain) Outward Bound Schools, Tresemer (1969), 
by means of interviews and participant observer 
techniques, looked at the Outward Bound program, from 
the points of view of "character training," "value- 
forming experience j " and, " education for personal 
growth," He concludes that "although not consistently 



American 
Indian world 
view and 
Outward 
Bound o 
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effective as an initiation rite into Manhood, 
participation in aji Outward Bound program can lead 
Self-conf idence, to a constructive development of self-confidence and 
Maturity. to greater m^iliurity for thoae who attend.. 

Hhoades (1972) loqka at the problem of Individu/il 
change in O.utward Bound, and applies ideas drawn from 

Change theory. contemporary change and transfer theory, 'ile applies 

the LewiT> .johein '*three-step model" for change (un- 
freezi change-, freezing) to an Outward Boup'l course. 
He identifies the role of th^ instructor as. crucial 
in the change stage, and points out that Outward 
Bound has J^ittle coiLtrol_o 

as students have returned home at this poinj^-^le^ 

presents a number of strategies and .^accompaixying rationale 

Transfer. for inGj?easing the likliehood^ha^' transfer will 

occur after the Outward -Bound course is .completed. 



RECENT EVALUATION WORK QN gUTWARD BOUND : 

' Much of. the above "lit eraturje..-i"S^^^^ 

in the sense that lit.tlei of it is specifically 
antended to give ' information to 4ecision-maker»s . 
within- the Outward Bound orgeunization . to assist. 
...therh in improving the quality of the program. In ' 
''T he MeasurmejLt of Affective Education ," Harmon (19.74) 
summarizes work ^c-^rried out by the Co]?prado and Texas 
Outward Bound Schools in evaluating their . programs ' 
effectiveness. The appraoch adopted here is to have 
programmers ^ identify their goals ,>ri thin three 
traditional areas: Affective, Cognitive, and Psycho- . 
Affective motor Domains. Working mainly in the Affective 

goals. Domain Harmon has encouraged Outward Bound to develope 

a series of goals ranging from general to specific. 
Checklists. Using checklists based on' these goals which are 

filled out by both instructors and students, "he hopes 
to provide ^'data to the organization indicating how 
well stated goals are being met. Some pilot testing 
of these materials has taken place but Insuf f iCiient 
•data has been gathered and analysed to indicate yet ^ 
if this line of ej^iquiry will provide useful information. 
However, Harmon's work in the development of goal 
statements and the use of checklists on Outward > 
Bound programs has engendered an increased awareness 
in many s'taff of the educational potential of the 
program. Staff are talking about goals and making 
program changes on this basis. 

A" somewhat different approach has been taken, by 

Smith (1973) in a paper entitled ' Final Report: Project 

to Design an Evaluation, of Outward Bound ." Although the 
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term "evaluation" is iised in the title, |this is 
more of a "research" attempt using Rosenj's distinct-ion.- 
Starting from a summary review of exist ijag literature, 
Smith states that "to date no evaluation study 

of Outward Bound (related to the Colorado School) has 
been conducted to^ demonstrate unequivocally the 
results of Outward Bound* Her charge isl to desigpi 
such a study. She begins with an examination of 
Harmon's work on ^^oal setting, interviews with putward 
Bound s'taff, and reading of Outward Bound literature. 
Prom these sources four main variables; are distilled out 
.as commonly accepted outcomes of Outward \ Bound pirpgrams. 

Th e s e are : 1 )„ _ s e 1 f _-e s t e em , - ( 2 1 se 1 f-awar ene s s , 

(3j self-assertion," (4) acceptance of others. A 
questionnaire has been devel©ped to test these four 
factors and has been pilot tested on a Colorado 
Outward Boimd School summer prograin. Her final study 
design consists of three seperate but interlinked 
approaches:. 

1. Study Ono ; A small tightly controlled 
experimental design involving random assign- 

> nient of 15 male and 15 female students 

to experimental and control groups. These 
students are observed during their field 
experience and respond to the questioiinaire 
developed for the study. Follow-up data 
will be collected on these students after 
their return to high school at the end of 
the. first and' seconf semesters following 
theirTOutward Bound course. (Data. will 
include grade-point average , extra-curricular 
activities, leadership activity, discipline,,: 
and adjustment ratings*) 

2. ^ Study Two : Employs a "Time-series design'* 

in which every student (except teachers) 
who goes through the C.O.B^S. summer program 
resjponds to the questionnaire. 

3. Study Three : Utilizes a "participant-observer": 

, for . descriptive evaluation aimed at elaborating 
on -the-;; Subtleties and details of thei program 
r- which Will not receive attention in studies 

; one- and, two. 

CONCLUDING REMARKS : I emphasise again that many of the studies reviewed 
here do not meet rigorous criteria for validity* However, the over- 
whelming indication of these data is that Outward Bound methods are 
successfully changing the lives of people who participate in the 
program, in the direction of the stated goals of the program. More 
work is needed if traditional educators are to be convinci^d of these 
values. ^ The work of Smith and Harmon seems most promising in this 
regard. 
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v/here available instruments do not measure what 

decision makers are moat concei*ned about, this 
■practice is absurd*** 

Judgemejrt. ( Outside expert model ) > "because 
Judgem,ent evaluation does not systematically 

collect decision makers goals data are 
likely to be irrelevent. 

5» Public Relations * "For improving the program 
image Provide data on goals which are 

judged in advance as most likely to succeed. 

Rosen includes in his article a description of the 
recently developed Fortime/Hutchinson Evaluation 
Methodology, (l) I recommend that anyone interested } 
in the evaluation of ICxperiential Educations programs 
who is feeling a lixtle bit overwhelmed by all this 
talk of internal and external validity, look at this 
material, toge'ther with Rosen's article. Two other 
important recent publications which will help give 
orientation before proceeding with a research or 
evaluation effort are: v _ 

1. The Methodology of Evaluation , by Michael ^ 
Scriven.Jfi, Ed(v;c<yt"tdy^^ f E^ft(«/<^lTofia ^ U)onne>^ 

2, The Coxmtenance of Edxacational Evaluatien^ 

by Robert Stake. In, "Teacher's College Recoird," 
.Vol. 68, NOo7t April I967. 

Scriven and Stake are two leading names in recent 
developments in evaluation which give hope to the 
possibility of developing meaningful approaches 
which are relevent and appropriate for Experiential 
Education programs* Whether you are interested in 
designing your own research or evaluation, obtaining 
the services of an. "expert" to do it for you, or 
simply in getting a handle on the current jargon t© 
help make sense or the reams of material available, a 
little time spent with the ideas of Rosen, Hutchinson, 
Scriven and Stake, will pay real dividends* 



W it h eB e~- th o ugh t s in- ra ind^;I ' v ill" 1 aun c h" in t o' a 
rapid overview of existing research and evaluation 
on Outward Bound and related educational programs* I 
will make no -attempt' to evaluate these studies using 
criteria of internal and external validity, but will 



(1) 



Major parts of the methodology are available in 
mimeographed form from. Dr. Thomas Hutchinson, 
Center for Educational Research, School of 
Education, University of' Massachusetts, Arr^erst, 
Mass. 01002. 
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simply remind you that the data from any study 
quoted here needs to be approached with caution# 
In some cases the changes reported mi^ht hot be^ 
the results of the program, and.resuJ.ts do not 
^ necessarily generalise to- other groups and other 

situations. You will- need to look at' individual 
studies yourself and 'make up your own mind on 
their validity. 

The available literature can be classified int© 
five categories: 

1. Studie^ of Outward Bound programs • 

2d Studies of educational programs related to 
\ Outward Bound. 



3» Studies on prograjns for Urban Youth and 
Le.linquents* 

4» Non-Empirical StudieSe 

5* Recent v/ork# * 



STUDIKS. OF OlPrWARD BOUm) PROGRAMS; 



Strengthening 
self-iraage. 



Social 

functioning. 



An early study by Richards (1966) used a Semantic 
Differential Test with a group of 90 boys enrolled 
in Colorado Outward Bound School 'course C. 11. Richards 
concluded that there had been a ''substantial strength- 
ening of the self-images of the great majority of the 
young men who went through the course." . Using interview 
techniques with a smaller sample^ Richards concludedL^ 
that (1) "boys with stronger self-images and more 
outgoing personalities will enroll and participate 
in Outward Bound more than boys whose self-confidence 
is not. so strongj^" (2) "The results of the program 
appear to be feli more in areas of social functioning 
than in academic pursuits." 



more 
stable 



A - studx" carried oat* in" Engtaixd, Strut t (l 966")" Wing'' 
the Sixteen Personality Factor Questionnaire, the 
Iiltelligence Progessive Matrices Test^ Self^-ratingSy 
sponsor ratings, and confidential Outward; Bound 
student reports, concluded that in conparison with: . 
a control group, gvrZ^ who had completed an Outward 
Bound course were relatively more stable, more • 
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ri ticalo 



Change in 
self-concept. 



Self-imcige, 



Control 

personal 

fate. 



Changes in 
personality and 
values. 



Tolerance of 
othersv 



Positive 
self-conoe*pt r 



urn. 



dependable, moro critical, livlier, less sensitive, 
and less con-ventional. 

L/ 

Clifford^ and Clifford (196?) examined the effects of 
a Colorado Outv/ard Bound School coiu?se on adolescent 
boys. They concluded that '^overall change in the 
seif--concept did take place in the appropriate 
direction and discrepencies' between the self and 
the Ideal-self were reduced." 

An evaluate on^ of the Outvard Bound^Teacher *s Practic 
Hawkes et al. (1969) using a^ questionnaire and 
interviews some time after the program had ended 
concluded that "the Outward Bound" Teacher 's Practicum . 
...... is ^ experience which^ influenced or changed 

m'any teacher 's\self-image and view of their profession. 

In a study carried out at the North'^'Caroline Outward 
Bound School, Borstelpann ^^1969)? of the main • 

conclusions was that,/ "associated with the"^ program 
experience is a general increase among studeijts in 
the belief that they can control their personal fates." 
Borst,elmann aiso concludes that 9 "student ^Value 
hieraTchies .... show some tendoncy to move towards 
staff positions about the impor^tance of. competent 
behaviours." And,, in a cautionary note, he points 
out that -Outward BoUnd, "^does a better job with those 
students who arrive sharing convictioT^s about self— 
determination and getting on with the '.job in a 
cooperative, task'-centered taonner." / 

Shulze (^1970) , using a combination of questionnaire 
and personal interview, concluded, that . the Outward 
Bound course , " is an intense personal experience 
frequently involving changes in personality and 
values/'' and, "enables" (participants) to. look 
differently at themselves and the world. He also 
concluded that "one of the most significJant results 
of the Outward Bound' course "appears to be an 

appreciation »and tolerance of others different from 

"txrreself ."" ' " ' ^ '~\ 

In a study of 78 Toledo high school students^ which " 
used the goals of a high school guidance program as 
a frame of reference, Lovett (l97l) concluded that 
students who participated in Outward Bound gained a 
more positive self-concept, became more confident 
in decision*-making, and enjoyed better interaction 
with their peers. Lovett also concluded that high 
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